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SINGULAR  PERTURBATIONS  AND  SLOW-MODE 


APPROXIMATIONS  FOR  LARGE  SCALE  LINEAR  SYSTEMS 


by 


R.  E.  O'Malley,  Jr. 


The  solutions  of  large  linear  systems  with  slow  and  fast  modes  are  well 
approximated  away  from  endpoints  by  a slow-mode  solution.  This  corresponds  to 
the  use  of  outer  solutions  as  approximate  solutions  of  singular  perturbation 
problems  away  from  boundary  layer  regions.  This  paper  gives  an  algorithm  for 
obtaining  the  slow-mode  solutions,  and  illustrates  how  the  slow  and  fast  com- 
ponents are  obtained  for  the  initial  value  problem. 
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Decoupling  of  slow  and  fast  modes  and  the  singular  perturba 
ology  arc  alternative  ways  of  reducing  the  order  of  high  dimensional  mathemat- 
ical models  in  control  and  stability  theory.  Physically,  one  sometimes  knows 
which  variables  involve  predominantly  fast  or  slow  motions,  although  complete 
slow-fast  decoupling  is  rarely  known.  Likewise,  system  models  are  seldom  pre- 
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sented  in  the  traditional  singularly  perturbed  form  u = f(u,v,t,c),  ev  » 

g(u,v,t,e)  to  which  standard  theories  can  be  directly  applied.  Instead,  a 
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! modeler  must  numerically  identify  the  small  parameters  Involved  before  he  can 
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effectively  use  the  sinful,  ir  perturb.it  Ions  structure  to  design  reduced-order 
models.  One  can  attempt  to  transform  the  problem  Into  an  equivalent  problem 
with  decoupled  slow  and  fast  modes,  but  care  must  then  be  used  to  maintain  the 
physical  Interpretations  for  the  variables  used.  Despite  all  difficulties,  the 
high  dimensionality  of  truly  descriptive  models  prohibits  quick  numerical  Inte- 
gration and  forces  one  to  approximate  solutions  via  lower-order  models  corre- 
sponding to  a slow-mode  approximation  or  an  outer  solution  to  a traditional 
singular  perturbation  problem. 

The  simplest  example  of  such  a situation  Is  provided  by  the  linear  constant 
coefficient  system 

(1)  x « Ax 

on  a finite  Interval,  say  0 <_  t <_  1 , where  the  eigenvalues  of  A lie  in  two 
sctR  whose  elements  differ  greatly  In  magnitude.  Such  systems  could,  of  course, 
come  from  a control  problem  with  state  equation  x • Ax  + Hu,  feedback  control 
u " Cx,  and  A A + I1C1,  especially  when  (I  provides  hlgh-galn  feedback  (cf. 
Young  et  at.  (I<177)).  Specifically,  let  us  decompose  the  spectrum  \ (A)  of  A 
into  a slow  set  S and  a fast  (but  not  purely  oscillatory)  set  F with  n^ 
and  elements,  respectively,  such  that  n^  + n^  • n.  Thus,  we'll  take 

(2)  A (A)  - S U F 

where 

(3)  | s j « Re  |f| 

whenever  s C S and  f G F.  (If  we  asked  only  that  |s|  <<  |f|,  we  would  also 
allow  large,  hut  (nearly)  purely  Imaginary,  eigenvalues  leading  to  rapidly 
oscillating  modes.  Instead  of  the  boundary  layer  analysis  that  we  shall  employ, 
the  qul t c-d  1 f f erent  method  of  averaging  would  have  to  be  utilized  (cf. 
Hoppcnsleadt  and  Miranker  (I'l/p)).)  We  note  that  the  partitioning  (2)  of  A (A) 
Introduces  a small,  dimensionless  parameter 

(4)  c - Max  (»(/  Min  |f|  <<  1. 
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If  a more  refined  partitioning  of  the  spectrum  were  used,  we  would  obtain 
several  small  parameters  of  decreasing  size,  corresponding  to  modes  with  several 
distinct  decay  rates. 

Our  algorithm  for  obtaining  approximate  slow-mode  solutions  of  (l)  will  be 
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as  follows: 

(a)  obtain  the  elgenva  lues  of  the  matrix  A 
eigenvalues  satisfying  (3), 

(b)  find  an  n.  * n matrix  solution  M 


and  select  a set  S of  slow 
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of  the  equation 


(3) 


AH  - H J 

0 8 H 


where  the  n ^ * iij  matrix  has  the  prescribed  spectrum  >(.1^)  “ S.  Re- 


sl 


Is  Invertible,  define 


arranging  the  rows  of  x.  If  necessary,  so  that 

(6)  L“-V»'r 


(c)  The  slow-mode  solutions  to  (1)  lie  In  the  column  span  of  the  exact 
* n matrix  solution 


(7) 


X (t)  - 

H 


1 


(All-V-X 


L i J 

where  we  have  used  the  partitioning  A 
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Remarks : 

(I)  Different  workers  might  naturally  make  different  choices  of  the  number 
nj  of  slow  eigenvalues.  Our  experience  suggests  that  the  approximations  to 
solutions  of  boundary  value  problems  with  bounded  solutions  will  remain  rela- 
tively good  within  (0,1)  even  for  moderately  large  e values  (say  t ~0.4). 

i 

The  primary  advantages  arc  gained  when  iij/n  Is  small.  | 

(II)  We  could  take  J to  be  the  Jordan  form  corresponding  to  the  slow 

eigenvalues  of  A (though  this  might  be  lmptudent  f i otn  a numerical  viewpoint), 
with  spanning  the  corresponding  n^  dimensional  generalized  eigenspneo. 

Rearranging  the  rows  of  M , then,  we  can  obtain  a nonsingular  matrix  and 

thereby  a solution  L. 

(III)  It  is  particularly  convenient  numerically  to  obtain  a matrix  1.  of 
small  norm.  This  will  correspond  to  having  the  last  n,  entries  of  x be 
primarily  fast.  Such  a condition  can  often  be  achieved  by  scaling  and  balancing 
techniques  which  reduce  the  coupling  between  slow  and  fast  modes.  Alternatively, 
a decoupling  matrix  I.  with  small  norm  would  result  If  physical  coordinates 
known  to  be  primarily  slow  were  used  as  the  flist  n^  components  of  x while 
coordinates  dominated  by  last  variation  be  used  for  the  final  components. 

In  general,  I.  Is  not  necessarily  small.  Instead  It  is  characterized  as 
the  it  j x n^  dimensional  matrix  such  that  the  change  of  variables 


j 


provides  the  block- 1 r 1. insular  system 


V 
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where 

(8)  X (B1)  “ S 

(9)  \(82)  - F 

and  where  L satisfies  the  algebraic  Rlccatl  equation 

(10)  Un  - A22l.  - Uj2L  + A , , - 0. 

Alternative  wavs  of  calculating  I.  Involve  the  Iterative  solution  of  this 
quadratic  equation  for  a sufficiently  good  Initial  guess.  For  small  L and 
A.,.,  nonsingular,  we  have  L » Aj'a  Justifying  the  initial  Iterate  used  In 
such  Instances  by  Chow  and  Kokotovlc  (197b).  Once  n ^ Is  chosen  and  A Is 
fixed,  there  Is  a unique  real  matrix  1.  satisfying  (8)-(10). 

(lv)  Because  A generally  has  both  large  stable  and  unstable  eigenvalues, 
the  n x n fundamental  matrix  c^ ^ for  (1)  cannot  he  readily  computed.  Since 

B “A  - A 1.  has  only  the  moderate  eigenvalues  of  S,  however,  the 
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n,  x n,  matrix  e can  be  obtained  by  explicit  formulas  or  by  many  standard 
methods  of  numerical  Integration. 

If  F contains  only  (large)  stable  eigenvalues,  the  solution  ot  the  initial 
Value  problem  for  (1)  will  be  bounded  and  for  t > 0 it  will  be  well  approxi- 
mated by  X k for  some  vector  k.  Solutions  to  terminal  value  problems  for  (1) 
Would  then  become  asymptotically  latge  (as  t * 0)  away  from  the  final  end- 
point, unless  the  terminal  values  were  restricted  to  an  u,  dimensional  manifold 
on  which  the  fast  growing  modes  would  not  be  excited.  in  general,  when  F con- 
tains m,  eigenvalues  with  negative  real  parts  and  m,  » n,  - m,  eigenvalues 
with  positive  real  parts,  (1)  will  have  an  m,  dimensional  manifold  ot  boundary 
layer  solutions  which  decay  to  zero  away  from  the  initial  endpoint  and  an  ro , 
dimensional  manilold  of  solutions  which  decay  to  zero  away  from  the  terminal 
endpoint  (alternatively,  an  m dimensional  manifold  of  rapidly  growing  solutions 


near  t ■ 0) . Boundary  value  problems  must  be  restricted  to  (host*  whose  solu- 
tions remain  bounded  throughout  the  Interval  as  r * 0 (cf.  Ferguson  (1975)). 
Such  solutions  will  be  well  approximated  within  the  interval  by  the  n^  dimen- 
sional span  of  the  slow-mode  matrix  of  (exact)  solutions  X , and  the 

s 

approx  ima  t Ion  will  Improve  there  as  c -♦  0.  Near  the  endpoints,  it  Is  necessary 
; to  use  the  n fast  modes  to  provide  appropriate  boundary  layer  behavior. 

(v)  We  note  that  the  nonsingul.ir  t ransfornu  t Ion 
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-K 

+ LK 


where  the  n^  * n^  matrix  K satisfies  the  Liapunov  equation 

(12)  KB 


V + *12  " °* 


converts  (1)  Into  the  block-d (agonal  system 


03) 
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2 J 


whose  slow  and  Iasi  modes  are  completely  decoupled.  (Note  that  wo  could  multiply 
the  second  equation  of  (13)  through  hy  the  small  parameter  r to  achieve  n 
system  In  the  standard  singularly  perturbed  form.  The  appropriate  reduced  (or 

v 

outer)  solution  would  be  V ( 1 3 - c Y (0) , Y_(t)  ”0.) 

I 1 s 

For  the  stable  Initial  value  problem  for  (1)  (with  n 
slow-mode  solution  will  be 


n,) . 


the  exact 


(14) 


"l  (A  -A  L)t 

x (t)  “ c (1  + Kl.  K)x(0) 

8 -1.  / "l 


where  K Is  the  unique  solut  Ion  of  (12).  If  K ■ 0,  wo  note  that  t lie  first 
nj  components  of  x will  contain  only  slow  modes.  Otherwise,  we  obtain  K by 
using  successive  approximations  In  the  linear  system 


(13) 


K - l (Ajj  - A12!.)K  - Al2)(A  ,2  + W ) 


-1 


.-1. 


The  scheme  will  converge  rapidly  because  IB^IIB,  I « 0(i  ).  It  Is  Important  to 

realize  th.it  the  slow-mode  solution  value  x (0)  can  dittoi  cons  Idet  abl  v ttom 
1 s 
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the  prescribed  value  x(0).  Tills  corresponds  to  the  usual  "boundary  layer  jump" 
of  singular  perturbations  theory,  showing  that  the  reduced  order  (outer)  solu- 
tion (14)  should  only  be  used  for  t > 0.  Indeed,  the  exact  solution  to  the 
initial  value  problem  Is  given  by 


x(t)  - x (t)  + x (t) 

8 1 


where  the  fast-mode  (or  boundary  layer)  solution  x^  Is 


-K  \ (A  4LA  )t 

(17)  x.(t)  - e 1 (L  1 )x (0) . 

1 1 + LK  n2 

n2  / 

Since  B,  • A,,  + I.A  , has  the  large  stable  eigenvalues  of  F,  x becomes 

* *4  Ik  l 

asymptotically  negligible  as  c •*  0 for  t > 0 and  the  slow-mode  solution  x 

s 

becomes  a good  approximation  to  x(t)  there.  j 

(vl)  Further  details.  Including  a justification  for  the  algorithm  and  more 

general  boundary  layer  structure,  are  contained  In  O'Malley  and  Amlrrf.t'n  ( 1 *>70) 

and  In  forthcoming  work.  Related  discussions  Including  examples  of  physical 

. I 

interest  are  contained  In  Chow  and  Kokotovlc  (147hu,b),  Oeoignkls  and  Bauer 

(19/8) , Ha t the  1 J (19/9),  and  Toneket/ls  and  Sandell  (1977  ).  j 

(v 11)  The  algorithm  proposed  has  been  applied  to  a number  of  physical 
systems  with  orders  n up  to  32.  Rather  good  results  were  obtained  In  reduc- 
ing the  1 b*  *'  order  model  of  an  F-100  turbofan  engine  to  a 3*'*  order  model, 
even  though  the  t Involved  was  the  not-so-small  paramotet  0.383. 

The  longitudinal  dynamics  of  an  K-8  aircraft  can  be  modeled  hv  a fourih- 

i 

order  linear  system  with  slow  eigenvalues  -0.007b  * 10.07b  and  fast  eigen-  l 
values  -0.94  * 13.0,  corresponding  to  the  small  parameter  0.074.  The 
physical  variables  of  velocity  variation  and  flight  path  angle  exhibit  primarily 
slow  response,  while  the  angle  of  attack  and  pitch  rate  ate  predominant  1 v fast 
variables.  This  is  illustrated  in  Figures  1 and  2 where  both  the  exact  solution 
x(t)  and  the  slow  mode  component  x (t)  are  plotted  for  typical  slow  and  fast 
variables.  We  note  that  the  fast  mode  Is  present  In  both  variables,  but  that  It 
quickly  dies  out  so  that  x(t)  Is  well  approximated  by  x (t)  In  a tew  seconds. 
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ABSTRACT  (Continue  ,wi  tevetee  tide  It  neceeeecy  and  Identity  by  block  number) 

The  solutions  of  large  linear  systems  with  slew  and  last  modes  are  well 
approximated  away  from  endpoints  by  a slow-mode  solution.  This  corresponds 
to  the  use  of  outer  solutions  as  approximate  solutions  ot  singular  perturba- 
tion problems  away  from  boundary  layer  regions.  This  paper  gives  an 
algorithm  for  obtaining  the  slow-mode  solutions,  and  Illustrates  how  the 
slow  and  fast  components  are  obtained  for  the  Initial  value  problem. 
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